3D-DETNet: a Single Stage Video-Based Vehicle Detector

Video-based vehicle detection has received considerable attention over the last ten years and there are many deep learning based detection methods which can be utilized to solve the problem. However, these methods are devised for still images and applying them for video vehicle detection directly always obtain poor performance. In this work, we propose a new one-stage video-based vehicle detector combined with 3DCovNet and focal loss, called 3D-DETNet. Draw support from 3D Convolution and focal loss, our method has ability to capture motion information and is more suitable to detect vehicle in video than other one-stage methods devised for static images. The multiple video frames are initially fed to 3D-DETNet to generate multiple spatial feature maps, then sub-model 3DConvNet takes spatial feature maps as input to capture temporal information which is fed to final fully convolution model for predicting locations of vehicles in video frames. We evaluate our method on UA-DETAC vehicle detection dataset and our 3D-DETNet yields best performance and keeps a higher detection speed of 26 fps compared with other competing methods.